Add tutorial in docs about how to use benchmarks #110
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #110 +/- ##
=======================================
Coverage 81.37% 81.37%
=======================================
Files 9 9
Lines 204 204
=======================================
Hits 166 166
Misses 38 38 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
fusawa-yugo
force-pushed
the
fusawa-yugo/benchmark-tutorial
branch
from
2ef8525 to
bd4e292
Compare
fusawa-yugo
force-pushed
the
fusawa-yugo/benchmark-tutorial
branch
from
bd4e292 to
7a45bc5
Compare
Co-authored-by: Yoshihiko Ozaki <[email protected]>
| How to Use Benchmarks | ||
| ===================== | ||
|
|
||
| In this tutorial, we will explain how to use benchmarks in optunahub. |
There was a problem hiding this comment.
| In this tutorial, we will explain how to use benchmarks in optunahub. | |
| In this tutorial, we will explain how to use benchmarks in OptunaHub. |
There was a problem hiding this comment.
Please add some explanation of what OptunaHub Benchmarks is.
It is also helpful to add links to the Medium article (https://medium.com/optuna/optunahub-benchmarks-a-new-feature-to-use-register-various-benchmark-problems-694401524ce0) and how to implement original benchmarks (https://optuna.github.io/optunahub/generated/recipes/006_benchmarks_basic.html, https://optuna.github.io/optunahub/generated/recipes/007_benchmarks_advanced.html).
| :alt: Optimization History | ||
| :align: center | ||
| :width: 800px | ||
|
|
There was a problem hiding this comment.
Please add an example to use OptunaHub Benchmarks with optimizers other than Optuna, like https://medium.com/optuna/optunahub-benchmarks-a-new-feature-to-use-register-various-benchmark-problems-694401524ce0.
| :alt: Optimization History | ||
| :align: center | ||
| :width: 800px | ||
|
|
There was a problem hiding this comment.
Please add an explanation of evaluate_constraints, which allows constrained optimization with optimizers other than Optuna by directly evaluating constraints with user-provided parameters.
Co-authored-by: Yoshihiko Ozaki <[email protected]>
3 participants
Motivation
Guides on benchmarks in OptunaHub would be useful for users.
Description of the changes
I added use cases for normal problem, constrained problem, and multi-objective problem.